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CLOSED LOOP THREE COLOR ALIGNMENT FOR DIGITAL 

PROJECTION 
CROSS REFERENCE TO RELATED APPLICATIONS 

Reference is made to commonly-assigned copending U.S. Patent 

Application Serial No. (Attorney Docket No. 83620), filed herewith, 

entitled A CLOSED LOOP THREE COLOR ALIGNMENT SYSTEM FOR A 
DIGITAL PROJECTOR, by Nelson et al., the disclosure of which is incorporated 
herein. 

FIELD OF THE INVENTION 

This invention relates in general to a digital projection system and 
in particular to a closed loop three color alignment system for digital projectors. 

BACKGROUND OF THE INVENTION 

In a digital projection system involving the use or three separate 
light-modulating devices such as LCDs or micro-mirrors, image convergence 
depends upon the accurate registration of the three separate images created by the 
light modulating elements. For simplicity sake, we will look at this invention with 
regard to, but not limited in scope to implementation with an LCD device. With 
poor image convergence, the contrast and sharpness of the image both suffer, and 
in addition fringing of the image may occur. For example, a white dress may 
have a green fringe on one side and a red fringe on the other when shown against 
a dark background. These degradations are obviously undesirable in a projection 
system. Adding to the chance of poor convergence is the likelihood of higher and 
higher resolutions for a variety of applications including digital cinema With 
these higher resolutions comes increasing difficulty in achieving and maintaining 
convergence (usually a fraction of a pixel) due to the smaller pixels on the 
devices. In a device with large temperature changes such as a projector, even with 
attention to the thermal expansion of the LCD fixturing and other optical 
components, positional fixturing without complex designs or extravagant 
materials has a finite practical limit that is currently the same order of magnitude 
as the pixel size. 

A current method of performing a six-degree of freedom alignment 
(x, y, z, and rotations around x, y, and z) is to use a fixture to align the image 



modulating devices and hold them in place while they are fixed using solder or 
adhesive to a set of pads built into the optical system. The image modulating 
devices can then be removed from the fixture and re-used. This type of alignment 
can take a long time especially if the fixture adjustments are not entirely 
orthogonal and independent. (Rotation adjustments are seldom possible around 
the exact center of an image modulating device.) For example, in rotating the 
image modulating device around the z-axis to eliminate a skew error, one could 
potentially also be altering its position in x and y. This method requires high 
precision fixturing, and possibly many iterations to achieve the required 
alignment. Even if the proper alignment is achieved with the fixture, errors in the 
final position of the image modulating devices can result. For example, though 
this method is performed with the image modulating devices and projector 
running, due to the need for access to the device, the system may not have all of 
it's covers and cooling operational. Therefore, as the alignment is not performed 
at the projector's working temperature, this can lead to positional errors, and a 
resulting lack of color convergence when the projector is run completely 
assembled at a different operating temperature. Convergence using this method 
can also suffer from positional inaccuracies resulting from induced stresses in the 
joints caused by the solder cooling or the adhesive shrinking. This is a one-time 
adjustment and does not allow for realignment at a later date. 

An alternate method is to provide manual adjustments on some or 
all of the axes in the projector to enable in-projector alignment. This method is 
potentially expensive as the precision adjustment remains with the projector, 
potentially cumbersome in terms of getting adjustments for all of the stages to fit, 
and difficult to design athermally. For some applications, it may also be possible 
to rely on simply butting the image modulating devices to datum structures within 
the projector. Even with precisely ground components and tight manufacturing 
tolerances, this method is seldom accurate enough for high-resolution systems. 

Macauley et al. discloses an image registration system in U.S. 
Patent No. 4,683,467 which registers multiple images on a screen. This system 
makes use of sensors mounted to the screen as input for the correction system. 
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Because the detection takes place at the screen, photodetectors are required to be 
located on or near the screen detracting from the viewing experience. 

Ledebuhr in U.S. Patent No. 5,170,250 shows an internal image 
registration system which is suitable for use in a projector. The light valves 

5 produce alignment beams which are sensed internal to the projector by 

photodetectors to control the CRT light valves. A disadvantage of this invention 
is that a spatial relationship needs to be maintained between the three 
photodetectors. Such a system is not capable of correcting for either skew or 
focus. In addition, the correction methods used will not work for image 

10 modulating devices such as LCDs and micro-mirrors which cannot be aligned 

electronically to high resolution. 

Hara et al. in U.S. Patent No. 5,592,239 disclose a projector device 
with the capability to properly register the image in translation and rotation. 
However, the device is only able to be used during an off-line alignment of the 
1 5 projector because the detection system is not suited to closed loop operation whilst 

projecting images. 

There is a need for a method and apparatus for creating and 
maintaining proper pixel alignment without requiring high-precision fixtures and 
projector components. Also there is a need for a method and apparatus for 

20 performing a continuous image registration in a projection system. 

SUMMARY OF THE INVENTION 
The problems discussed above can be overcome and better 
performance achieved with a closed loop system for aligning and maintaining the 
alignment of these devices. Briefly, according to one aspect of the present 

25 invention a digital projector that has closed loop three color alignment comprises a 
light source where an optical engine splits a beam of light from the light source 
into first, second, and third wavelength bands. A first, second, and third spatial 
light modulator imparts image data and first, second, and third fiducial data 
respectively to the first, second, and third wavelength bands. The first, second, 

30 and third wavelength bands are directed to the first, second, and third spatial light 
modulator, respectively. A combiner combines the modulated first, second, and 
third wavelength bands. A diverter diverts a portion of the combined modulated 



wavelength bands to at least one sensor. The sensor then senses a relative position 
of the fiducials and sends the position information to a microprocessor. The 
microprocessor then determines an error based on the relative position of the 
fiducials. The microprocessor sends a signal to at least one component of the 

system to resolve the error. 

Consistently better image quality can be achieved by eliminating 
thermal errors in the mounting of image modulating devices in real time providing 
perfect registration over a wide temperature range. An additional benefit is that 
the initial alignment to mount the image modulating devices need only be as good 
as a few pixels simplify the fixuring and procedures required. The design of the 
projector can also be made simpler by not requiring as good thermal stability of 
the image modulating devices and associated optics mounting. 

The border pixels of the three separate image modulating devices 
to provide a fiducial pattern that can be used for alignment, for example multiple 
pixels in each corner of the device. Upon recombination of the light from each of 
the three devices, the single light path is split into two components. The majority 

r 

of light will be the normally projected image area, while the remainder of light, 
containing the fiducial information in the border areas is cropped. This small 
amount of light (also containing the fiducial surround) is directed to a sensor, 
which will be used to determine the pixel locations of the fiducial pattern and in 
turn, determine the required positional. Determination of which device requires 
positional adjustment can be done utilizing many means, including, but not 
limited to a selective application of filters to separate the colors, or by illuminating 
the fiducial patters on the three image modulating devices in a predetermined 
sequence. If a correction is required, actuators on the red and blue image 
modulating device mounts are powered to bring them back into alignment with the 

green reference channel. 

In one embodiment of this idea, if alignment to within a half pixel 
is adequate, it would be possible eliminate the actuators and make all of the 
correction electronically, shifting where the row and column data begins and ends 
separately for the three channels. The simplest useful correction would be a 
simple x and y translation which would require only one fiducial point. A more 



useful correction accounting for possible skew requires at least two fiducial 
points. Embodiments performing these types of correction can be implemented 
moving optical components such as mirrors, prisms or simply the image 

modulating devices. 

BRIEF DESCRIPTION OF THE DRAWINGS 

Figure 1 shows an image modulating device with border pixels 

being used in the method. 

Figure 2 shows the complete optical system of a preferred 

embodiment. 

Figure 3 shows a variation of the preferred embodiment in the 

fiducial monitoring portion. 

Figure 4 shows another variation of the preferred embodiment in 

the fiducial monitoring portion. 

Figure 5 shows another variation of the preferred embodiment in 

the fiducial monitoring portion. 

Figure 6 shows a variation of the preferred embodiment with focus 

sensing optics and fiducials. 

Figure 7 shows focus sensing fiducials, sensors, spot shape upon 

defocus, and a sample focus error signal. 

Figure 8a shows an optical correction device which allows for a 

translation of the image. 

Figure 8b shows an optical correction device which allows for a 

rotation of the image. 

Figure 8c shows an optical correction device which allows for a 

rotation of the image. 

DETAILED DESCRIPTION OF THE INVENTION 

Turning now to Figure 1, an image modulating device assembly is 

shown. It consists of an image modulating device mounting plate 100 to which an 

image modulating device 101 is bonded. This mounting plate is used to fix the 

image modulating device into the optical system. The attachment of the image 

modulating device to the optical system can be done by soldering or bonding it to 

a mating surface in the optical system. Contained within the image modulating 



device is an active pixel area 102 containing active pixels which can be imaged- 
wise turned on and off. This active pixel area is farther broken down into a 
central pixel area 103 to be used for the projected image, and a surrounding area 
to be used for fiducials 104. This surrounding area of the three separate image 
modulating devices can be used to provide a fiducial pattern that can be used for 
alignment, for example a spot in each comer. The size of the surrounding area is 
not important to the invention, but is preferably small such that a majority of the 
active pixels can be used for the image. It is also preferred to leave a buffer 
section of unused pixels between the active area used for imaging 103 and the 
active area used for fiducials 104. This is desirable such that the fiducial detection 
devices which will be discussed do not themselves have to be aligned accurately 
to the image. To facilitate detection by the sensor 21 of Figure 2, it is also 
possible that the fiducials 1 10a and 1 10b comprise more than one pixel. The 
fiducial can be can be made up of a combination of on pixels surrounded by off 
pixels, or off pixels surrounded by on pixels. Similarly, they may be defined in 
particular patterns, such as cross shapes or other patterns which may enable 
recognition of a deviation from the proper co-aligned state. An example of such a 
pattern is shown in the detail enlargement of fiducial 1 10a. 

The following discussion applies to Figures 2-5. All of these 
figures show illumination optics 30, an optical engine 50, and a fiducial 
monitoring and projection section 70. There are many configurations of 
illumination optics 30, optical engines 50 commonly practiced, and the specifics 
of the illumination optics 30, and the optical engine are not critical to the 
invention, but are included for completeness. 

A lamphouse 1 provides illumination for the projector. A cold 
mirror 3, separates the visible light from the infrared to limit the amount of heat 
introduced to the remainder of the optics. Input optic lenses 2 shape the beam for 
efficient coupling of the visible illumination into integrating bar 4 which is then 
used make the light, relayed to the image modulating devices 11, 12, and 16, by 
lens 5, more uniform. The white light is then split into three spectral bands, 
typically red, green, and blue, using dichroic filters 6 and 8, each spectral band 
provided with a means of polarization separation, such as polarization 
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beamsplitters 9, 10, and 15. Each spectral band is therefore polarized upon 
reflection prior to reaching image modulating devices 11, 12, and 16. Image 
modulating devices 1 1, 12, and 16 are mounted on actuation devices 13, 14, and 
1 7 respectively. These actuation devices are used to provide the registration 
5 alignment of the images from each of the three spectral bands. Image modulating 
devices 11,12, and 16 containing arrayed pixels can rotate the incoming 
polarization on an individual basis, thereby causing the light reflected off these 
devices 1 1 , 12, and 16 to transmit through the dielectric polarizing coatings of 

beamsplitters 9, 10, and 15. 
! o Referring now specifically to Figure 2, in the fiducial monitoring 

and projection section 70, following the dichroic recombining element 18 of the 
optical engine 50, a partial mirror 19 is placed to sample the illumination. An 
example of such a device is a plate glass with a dielectric anti-reflection coating 
on the second surface. The first surface, being uncoated, will have reflection 
1 5 according to Fresnel reflection laws. Alternatively, this first surface may be 
Q coated with a dielectric coating to provide for a tuned amount of reflection. The 

□ maj ority of the light continues through the partial mirror, the fiducials are 

N removed by a mask 22 which occludes the area inside the active pixel area used 

for fiducials 104, and is projected to a viewing screen 24 as in any other projector 
20 using a projection lens 23. The fraction of light diverted by the partial mirror 19 
is then imaged by a lens 20 onto a sensor 21, which is able to gather pixel 
locations of the fiducial marks. An example sensor may be a single CCD imager, 
or two smaller CCD imagers placed only to detail the image of the fiducials, a 
photodiode, or any other light-sensing device. These pixel locations are then sent 
25 to and operated on the microcontroller 25 which, using an algorithm to be 

described later determines based on the positions of the fiducial pattern on all 
three channels, if a correction is required. This determination results in control 
signals to one or more of the image modulating device actuators 13, 14, and 17. 
These actuators then in turn translate or rotate the image modulating devices 1 1 , 
30 12, and 16 such that thy are brought into correct alignment with each other. This 
sensor determines the pixel locations of the fiducial pattern on all three colors and 
determine if a correction is required. If a correction is required, actuators 13, 14, 
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and 17 on the red and blue image modulating device mounts are powered to bring 
them back into alignment with the green reference channel. 

There are several methods which can be employed to present the 
fiducial information in 1 1 Oa and b to the sensor 21. In a preferred embodiment, 
5 the image modulating devices 1 1 , 1 2 and 1 6 image the fiducial marks 1 1 0 
sequentially in a predetermined temporal sequence such that a monochrome 
sensor can be used. For example, if the predetermined order is green, red, blue, 
delay. The green image modulating device 16 displays it's fiducials while the red 
and blue image modulating devices are blank. The pixel locations on the 
1 0 monochrome sensor 2 1 are stored in memory, and then the red image modulating 
device 1 1 fiducial pattern 1 10 is activated, and the locations of the red fiducial 
pattern are stored. Finally, the same procedure is repeated with the blue device 12 
such that the monochrome sensor has now gathered the pixel locations of all three 
colors. These stored pixels locations are then analyzed by a microprocessor 25 to 
1 5 determine whether or not they are in acceptable convergence. The microprocessor 
is able to clock using the delay and then register the separate color signals in order 
to differentiate which fiducial signal corresponds to which image modulating 
device. 

i 

A second embodiment introduces a series of colored filters 27 in 
20 front of a monochrome sensor. Firstly a green filter is placed in front of the 

sensor allowing the green fiducial information to be gathered. Continuing in a 
similar fashion, the fiducial data from each color can then be individually gathered 
by a monochrome sensor. This method enables each of the image modulating 
devices to display their fiducial information continuously. For convenience, the 
25 three color filters are likely placed on a rotating wheel. 

A third embodiment is to simply use a color sensor. In all of the 
embodiments, it is important that the sensor have adequate resolution to 
adequately capture the fiducial information. As corrections of fractions of a pixel 
are required to maintain a high quality image on the screen, it is required that each 
30 fiducial 1 1 0 be mapped onto multiple sensor pixels. 

It should be noted that although the invention is shown with the 
ability to translate and/or rotate all three light modulation devices, that this is not a 
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requirement of the invention. One of the image modulation devices may be 
permanently mounted in a fixed position and used as a reference for the other two 
colors. This is most likely the green channel 16 and 17, and in future will be 

discussed as the fixed channel. 
5 Many configurations are possible, however, the exact configuration 

is not critical to the invention. All optical engines that split the light so it is 
modulated by at least two separate light modulation devices will benefit from the 
invention. 

Referring now to Figure 3, the input optics 30, and optical engine 
10 50 are identical to those of Figure 2 and will not be discussed in detail again. The 
partial mirror 19 of Figure 2 has been replaced by a periphery sensor 21a. A 
5 significant advantage is realized as this sensor replaces the partial mirror 19, the 

sensor 21 and the mask 22 of the previous method and serves all three functions. 
A lens 20 is required such that the periphery sensor is at a focused image plane. 
1 5 The sensor 2 1 a both gathers the fiducial data 1 1 0, and blocks it from being 

projected to the screen 24 by the projection lens 23. Because the sensor is being 
place in a large amount of illumination, it may be desirable to have a light 
reducing element integral to the sensor. In addition, because of the absorbed light 
energy, the mounting for a periphery sensor may require a heat sink (not shown). 
20 It may be impractical to insert a sequence of filters 27 into such a 

system as if they occluded any of the active pixel area designated for images 103, 
the image would be degraded. It is therefore preferred that in this embodiment, 
either a color sensor is used on the periphery, or the temporal discrimination 
method discussed earlier is used with a monochrome sensor. As before, the 
25 microprocessor 25 determines whether the fiducials, and therefore the images are 
in acceptable convergence. If not, appropriate corrections are made either 
electronically (adjusting the start and stop rows and columns for the channels) or 
mechanically (adjusting the physical locations of the sensors or rotating optical 
mirrors) such that the fiducials and therefore images again line up. Due to the 
30 tighter control of the manufacturing process for the sensors, it may be assumed 
that if the fiducials line up, then so do the images. 
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Turning now to Figure 4, as before, the input optics 30, and optical 
engine 50 remain unchanged. In this embodiment, rather than inserting a digital 
periphery sensor 21a into the path, a simpler periphery mirror 19a is inserted. 
This periphery mirror 19a, unlike the partial mirror 19, obscures all of the active 
5 pixel area used for fiducials, therefore eliminating the need for a separate mask. 
The fiducial information is then relayed to the sensor 21 by a lens 20, and the 
remainder of the process is as described earlier. As before due to the amount of 
illumination being diverted, it may be advantageous for the sensor to include a 

light reducing element. 
10 Another embodiment is shown in Figure 5. A mask 22, is inserted 

into the light path to block the fiducial information from being projected. As was 
the case in figure 3, a lens is required to provide a focused image at the imaging 
0 surface 26 of the mask 22. This imaging surface is preferably flat and able to 

'"f provide good contrast when impinged upon by the fiducial information. An image 

S 1 5 sensor 2 1 , such as a CCD camera, then captures the reflected light from the mask 

O 22 and supplies the fiducial information to the microprocessor 25 as before. A 

Irs 

q heat sink may be required due to the amount of illumination being absorbed, and 

W reflected light becomes stray light inside the projector and is preferably 

absorbed before it can be projected causing undesirable flare. 
20 The microprocessor 25 establishes a control loop. After collecting 

the positional information from the sensor 21, an algorithm determines an 
appropriate corrective action. This control loop can be repeated immediately for a 
continuous closed loop correction. Depending on the algorithm used by the 
microprocessor, however, this might cause excessive corrections to be made. For 
25 example, if the algorithm has too small a "dead-band" or amount of acceptable 
error, it might be found that if the means of correction does not have adequate 
resolution, a correction is implemented each time the loop is run in the opposite 
direction. For this reason, and to save on processing/actuating power etc. a 
significant delay might be implemented between successive corrections. Given 
30 the relatively slow time constant for the most likely thermal and other 
disturbances to the system, this should not be a problem. 



Whereas the positions of the fiducial markings on the sensor could 
be used for the feedback to the actuator, it may be desirable to have a separate 
positional feedback at the image modulating device site. In such an embodiment, 
based on sensor input, the controller can send a discrete move distance and 
direction to the actuator that will then have the capability to reliably achieve the 
desired position without further feedback from the fiducial sensor. This 
decoupling of the feedback loops has certain advantages. Firstly, the actuator is 
not limited to the rather slow expected time constant of the vision system. For 
example, piezoelectric motors working with integrated capacitive displacement 
sensors can achieve response times in a few milliseconds which is considerable 
faster than the vision system can or is required to operate. Secondly, it is 
desirable to be able to isolate problems in the system to either the vision system, 
or the actuator, which would not be possible in a single feedback loop. Thirdly, 
there are off the shelf controller systems, which are designed to work with paired 

actuators and position systems. 

It is recognized that the resulting error when looking at the sum of 
the differences of the distance between the reference channel and the other two 
channels may not ever be able to reach zero. In an ideal world of course with the 
ability to correct for x, y, and skew errors, this should be possible. However, as 
lenses refract differing wavelengths of light to a different degree, there may be 
magnification differences between the color channels as well as differences 
resulting from manufacturing of the image modulating devices. Neither 
magnification nor lack of squareness of the fiducial pattern can be corrected using 
this method. It is therefore recommended that an error be allowed, and the 
algorithm programmed to minimize this error. 

The type of actuation required will produce very small 
displacements precisely (on the order of a few microns). The ideal actuator 
produces this amount of displacement in a small package. Preferred are 
piezoelectric actuators for their small package size, reliability, quick performance, 
commercial availability, and precision. When coupled with a flexure mounted 
stage setup, piezo actuators can provide a low friction / stiction movement with 
adequate precision and travel range. For example the P-500 series multi-axis 
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piezo flexure nano-positioners from Polytec PI Inc. in Auburn, MA would have 
the appropriate capabilities for this application including a version with all 6 
degrees of freedom and its own feedback. 

Piezo motors can be costly. This invention is not limited to the use 
5 of these motors. One skilled in the art could certainly envision many other 

alternatives such as stepper motors with appropriately scaled down displacement 

ranges through levers and lead screw. 

Turning now to Figures 6 and 7. The main invention as described 
would not correct for focus, luckily there is usually less precision required in the 
1 0 plane of the optical path. If focus correction were critical to a design, all 6 

degrees of freedom could be detected. This system can be implemented to also 
correct for relative defocus of the image modulating devices. One method would 
be to over sample the fiducials with the CCD sensor. An algorithm could be 
created in order to minimize the number of pixels that the fiducials occupy on the 
1 5 CCD. This would be disadvantaged in that in order to determine the optimum 
position of focus, the image modulating device must be moved. An alternate 
approach would be to create a specific fiducial set for focus detection. One 
example would be to use a round spot fiducial, as shown in figures 61a and 61b on 
the image plane of fiducials 62a and 62b used for convergence correction. Optics 
20 can be implemented such that astigmatism and power is induced into the round 
spot of these fiducials. For example, placing a cylinder lens, spherical lens 
combination into the field that relates to the diagonal imaging the focus fiducials 
as in figure 28. Quad sensors, figures 67a and 67b, are placed in the image plane 
of these fiducials, with its cells at a 45 degree angle with respect to the cylinder 
25 lens creating the astigmatism. The position of the quad cell is such that best focus 
is at the "disk of least confusion" for the image of the fiducial. This intermediate 
image between the two line focus positions created by the cylindrical lenses is 
round as shown in figure 64. Upon defocus of the image modulating device in 
one direction, the "disk of least confusion" begins to form a line focus, as in figure 
30 63. This effectively removes light off of two of the cells, b and c of the quad 

detector, and places it on the alternate two cells, a and d. Similarly, if the image 
modulating device is defocused in the opposite direction, the opposite two cells 
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gain the additional light. In this fashion, by adding the light levels from the 
diagonal cells and subtracting this from the other diagonal cells and normalizing 
this by the sum of all cells, a directionally deterministic signal, as shown in figure 
66, is created which is independent of light level. Implementation of this type of 
5 system is well known in the art. Examples may be found in many camera systems 
and optical recording systems. Other similarly common means of focus detection 

may be used for this application. 

Figure 8a shows an optically transparent plate 80 which can be 
used to translate the image. The plate as illustrated has the capability to rotate 
1 0 between two angularly different positions 84 and 8 5 such that the light beam 8 1 is 
translated between corresponding positions 82 and 83. Two such plates or a 
single plate which has the ability to tip and tilt in two directions can be used to 
translate the image in both the x and y directions. The plate 80 can be inserted in 
the optical path in many locations, most preferably between the polarizer cube 9, 
_ 15 1 0 and 1 5 and the combining x-cube 1 8. Alternatively, the plate 80 can be 

b inserted between the polarizer cube 9, 1 0 and 1 5, and the image modulating 

Q device 11, 12, and 16. 

HJ Figures 8b and 8c show two methods of optically rotating an 

image. Prism 90 when rotated causes twice the amount of rotation to occur 
20 between the light beam 9 1 and the output light beam 92. Similarly a K mirror 94 
provides the same ability to rotate the light beam 93 and output light beam 95. 
The prism 90 and K mirror 94 can be placed in the optical system in the same 
positions previously discussed for the optically transparent plate 80. 

The invention as described supposes a 6 degree of freedom 
25 actuation possibility for at least two of the image modulating devices, however, 
there are many embodiments which can be implemented more simply. 

Firstly, if alignment to within a half a pixel were adequate, it would 
be possible to do away with the actuators entirely and make all of the corrections 
electronically, shifting where the row and column data begins and ends separately 
30 for the three channels. Electronic correction such as this is practiced commonly, 
and is described in U.S. Patent No. 5,729,245 by Gove et al. Obviously, in such a 
system, no capability exists for either skew correction or focus correction. 
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However, many less critical applications can tolerate as much as a half a pixel 
correction, and such a system is much simpler to implement with no moving parts 
in the image modulating device area. In all systems involving substantial 
correction which occurs all at one time, such as is the case when the spatial light 
modulator driver signals are indexed by a pixel, it is desirable to make these 
corrections at a time when it is least impactful on the viewing of the images. 
Ideally, large immediate corrections to the image alignment should be performed 
during scene changes or when the image field is substantially uniform. Other 
more subtle corrections performed mechanically or optically can be implemented 
continuously or discretely without regard to scene content without negatively 

impacting the viewing experience. 

A second embodiment which also is simpler to implement than a 
six degree of freedom correction is a mechanical correction of x and y only. In 
addition to simpler actuating mechanisms, a great advantage can be realized in 
such a system by recognizing that only one fiducial point per color channel is 
required. Only requiring a single point to be imaged on the sensor 21 allows for 
either greater resolution or a much smaller sensor. 

A third embodiment is to eliminate the three focus corrections, and 
simply correct for skew, and x and y translations. This level of correction requires 
at least two fiducial points, and three independent actuators. Such an embodiment 
eliminates three degrees of freedom creating a simpler actuation mechanism, but 
maintains the ability to perform the most sensitive corrections for convergence. It 
is desirable in such a system to design a large depth of focus at the image 

modulation device. 

A fourth embodiment is to use the same fiducial gathering methods 

as discussed, but keep all of the image modulating elements fixed. The 
convergence and focus correction can then be achieved through the actuation of 
other optical elements in the optical engine. As shown, prisms or k-miirors can be 
rotated rather than rotating the image modulating device, and planar transparent 
optical plate elements can be rotated in two directions providing an effective x and 
y translation. 
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A fifth embodiment would be to use all of the detection and 
correction means described above in an off-line calibration routine. The existing 
invention, as described, requires "wasting" of a few border rows and columns, 
which could be used for image data. In addition, for continuous correction, in 
many of the fiducial gathering embodiments, the invention requires that a small 
amount of light, which would add to the screen illumination, be diverted to a 
sensor. If these limitations are critical for a design, an off-line calibration routine 
could still be done while the projector is not showing image data using the same 
method. Any of the mechanical, optical, or electronic correction means could be 
used. 

A sixth embodiment combines the use of mechanical and electronic 
correction. The electronic correction can be used as a means of coarsely aligning 
the image modulating device in x and y, thus permitting the use of a mechanical 
actuator with a lesser positional operating range. Without the constraints of a 
larger operating range, actuators with much higher resolutions can be used making 
finer correction possible. In addition, the correction algorithm can implement an 
electronic pixel correction if the mechanical actuator runs out of operating range. 

Many other embodiments can be conceived combining some 
elements of electronic, optical and mechanical correction. For example, it may be 
beneficial in a system to perform the x and y correction electronically, and then 
the skew correction with a prism or mechanical actuator. 

The invention has been described in detail with particular reference 
to certain preferred embodiments thereof, but it will be understood that variations 
and modifications can be effected within the scope of the invention. 
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Blue polarizer cube 
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Red imaee modulating device 
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Blue image modulating device 
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Red image modulating device actuator 
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Blue image modulating device actuator 
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Green image modulating device 
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Green image modulating device actuator 
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Lens 
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Imaging surface 
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Color filters 
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Cylindrical/spherical lenses 
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Input optics 
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Optical engine 
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Fiducial detection plane 
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Imaee of Focus Fiducial 1 
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Image of Focus Fiducial 2 
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Image of Fiducial 1 
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Image of Fiducial 2 




63 


Early Defocused Image Of Focus Fiducial 
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In Focus Image of Focus Fiducial 
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Late Focus Image of Focus Fiducial 
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Fiducial Monitoring and Projection Portion 
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Image modulating mounting plate 
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Image modulating device 
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Active pixel Area 
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Area inside active pixel area used for fiducial pixels 
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Fiducial 1 
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Fiducial 2 
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